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Overview 



Although much is known about how to help unemployed welfare recipients find jobs, little is 
known about how to help them and other low-wage workers keep jobs or advance in the labor 
market. This report presents an assessment of the implementation and effects at the one-year fol- 
low-up point of a program in Salem, Oregon, that aimed to promote better initial job placements, 
employment retention, and advancement among applicants to the Temporary Assistance for Nee- 
dy Families (TANF) program who were unemployed. The program is part of the Employment 
Retention and Advancement (ERA) project, which is testing 16 models across the country. The 
ERA project is being conducted by MDRC, under contract to the U.S. Department of Health and 
Human Services, with additional funding from the U.S. Department of Labor. 

The Salem ERA program began operating in May 2002. Called VISION, it was jointly operated 
by staff from the local welfare agency and a local community college, and it was located at a One- 
Stop Career Center. The program provided TANF applicants with job search and placement ser- 
vices, including workshops that focused on future job retention and career paths. Then, once 
clients secured employment, VISION was to continue with postemployment services to promote 
job retention and career advancement. VISION is being evaluated using a random assignment 
research design whereby eligible individuals were assigned, through a lottery-like process, either 
to a program group, whose members participated in VISION, or to a control group, whose mem- 
bers participated in Oregon’s standard welfare-to-work program (known as JOBS). 



Key Findings 

• A pre- to postemployment model of providing retention and advancement services 
was difficult for program operators to implement. During the preemployment period, 
VISION had more frequent contact with clients and delivered additional workshops and 
other services that had a strong retention and advancement message. A high proportion of 
VISION group members participated in group job search. However, VISION staff strug- 
gled to develop and implement the postemployment retention and advancement compo- 
nent. They had a difficult time managing both employed and unemployed clients, and the 
bulk of staff time was spent on preemployment responsibilities, particularly eligibility is- 
sues and individual crises. 

• VISION operated in a difficult environment. Implementation was further complicated 
by the fact that the program operated in a difficult economic and fiscal environment and 
suffered from staff turnover and cutbacks, funding shortages, and management issues. 

• VISION did not achieve its goals of helping participants secure better jobs and ad- 
vance in the labor market. VISION did not generate statistically significant impacts on 
employment, retention, or advancement during the first follow-up year. However, the in- 
creased attention and longer-term contact provided by staff to VISION clients led to their 
having greater access to public assistance — including TANF, food stamps, and public 
health insurance — during the first year of follow-up. 

These results are not the final word on the VISION program in Salem. MDRC will continue to 

track the impacts of VISION using unemployment insurance records. 
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About the Employment Retention and 
Advancement Project 



The federal welfare overhaul of 1996 ushered in myriad policy changes aimed at getting 
low-income parents off public assistance and into employment. These changes — especially 
cash welfare’s transformation from an entitlement into a time -limited benefit contingent on 
work participation — have intensified the need to help low-income families become economi- 
cally self-sufficient and remain so in the long term. Although a fair amount is known about how 
to help welfare recipients prepare for and find jobs in the first place, the Employment Retention 
and Advancement (ERA) project is the most comprehensive effort thus far to ascertain which 
approaches help welfare recipients and other low-income people stay steadily employed and 
advance in their jobs. 

Launched in 1999 and slated to end in 2009, the ERA project encompasses more than a 
dozen demonstration programs and uses a rigorous research design to analyze the programs’ 
implementation and impacts on research sample members, who were randomly assigned to the 
study groups. The study was conceived and funded by the Administration for Children and 
Families in the U.S. Department of Health and Human Services; supplemental support has been 
provided by the U.S. Department of Labor. The project is being conducted by MDRC. Most of 
the ERA programs were designed specifically for the purposes of evaluation, in some cases 
building on prior initiatives. Because the programs’ aims and target populations vary, so do 
their services: 

• Advancement programs focus on helping low-income workers move into 
better jobs by offering such services as career counseling and education and 
training. 

• Placement and retention programs seek to help participants find and hold 
jobs and are aimed mostly at “hard-to-employ” people, such as welfare reci- 
pients who have disabilities or substance abuse problems. 

• Mixed-goals programs focus on job placement, retention, and advancement, 
in that order, and are targeted primarily to welfare recipients who are search- 
ing for jobs. 

The ERA project’s evaluation component investigates the following aspects of each 
program: 

• Implementation. What services does the program provide? How are those 
services delivered? Who receives them? How are problems addressed? 
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• Impacts. To what extent does the program improve employment rates, job 
retention, advancement, and other key outcomes? Looking across programs, 
which approaches are most effective, and for whom? 

A total of 16 ERA models have been implemented in eight states: California, Illinois, 
Minnesota, New York, Ohio, Oregon, South Carolina, and Texas. But — given significant 
differences in implementation in the three sites operating the Texas model — the project ul- 
timately will yield 1 8 independent estimates of site effectiveness. 1 

The evaluation draws on administrative and fiscal records, surveys of participants, and 
field visits to the sites. 



'Past reports list 15 ERA models. This number was changed, however, to recognize that one of the 
tests in Riverside, California, actually involved two models, given the two initiatives’ different sets of 
service providers and program rules. Note that “site effectiveness” refers to the effectiveness of different 
models or to the effectiveness of a model that was implemented very differently in a number of locations. 
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Executive Summary 



This report presents interim results for the Salem, Oregon, site in the national Employ- 
ment Retention and Advancement (ERA) project. The ERA project was conceived and funded 
by the Administration for Children and Families (ACF) in the U.S. Department of Health and 
Human Services and is also supported by the U.S. Department of Labor (DOL). The project is 
testing 16 innovative models across the country that aim to promote steady work and career ad- 
vancement for current and former welfare recipients and other low-wage workers. A great deal 
is known about how to help these groups find jobs, but there are few proven strategies for pro- 
moting retention and advancement. MDRC, a nonprofit, nonpartisan research organization, is 
conducting the ERA evaluation under contract to ACF and is producing a similar interim report 
for each site in the project. 

The Salem ERA program, which operated beginning in May 2002, targeted applicants 
of Temporary Assistance for Needy Families (TANF) cash assistance benefits who were unem- 
ployed. The program was designed to increase job placement, job quality, and advancement in 
the labor market for participants, who are mostly single mothers applying for welfare. 



Origins and Context of the Salem ERA Program 

Of the four ERA programs located in Oregon, the Salem ERA program, VISION (Va- 
luing Individual Success and Increasing Opportunities Now), was the only one designed to be- 
gin working with clients prior to their employment. The program began with job search and 
placement services, and, once clients were employed, VISION continued to provide services 
intended to promote job retention and advancement. 

As mandated by the State of Oregon, all TANF applicants, unless exempt, were re- 
quired to participate in job search activities; participation in job search activities occurred con- 
currently with applicants’ eligibility determination. During a period that could last up to 45 days 
(called the “assessment period”), the regular welfare -to-work program, Job Opportunities and 
Basic Skills Training (JOBS), provided applicants with a series of basic job search and prepara- 
tion workshops. Services were provided by staff from the local community college, Chemeketa, 
and were delivered at branch offices of the Salem Department of Human Services (DHS). The 
JOBS program embodied a “work-first” philosophy, and services ended once clients found jobs 
and DHS determined them to be “over income” for TANF assistance. 

In Salem, the welfare, workforce, and community college systems had a long history of 
working together to deliver employment-related services. VISION built on these longstanding 
relationships and was created to provide applicants with more than the basic preemployment 
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services provided by JOBS. Unlike that program, VISION was designed to help clients identify 
and work toward a job of interest, and services took place at the local One-Stop Career Center, 
rather than at the welfare office. 1 

Retention and advancement were emphasized from the onset of the VISION program, 
and the same staff worked with clients both before and after clients’ employment. The reasons 
behind this design were threefold: (1) to introduce the idea of job retention to clients prior to job 
placement, (2) to encourage clients to think about career goals and advancement early on, and 
(3) to establish a rapport that would ensure clients’ long-term engagement and, therefore, partic- 
ipation in VISION’s postemployment services. The goal for the postemployment phase was to 
help clients follow through on the goals that they had identified prior to their employment. The 
ERA Salem test determines whether such a model helped participants fare better in the labor 
market than those who went through the regular welfare-to-work program, JOBS. 

VISION operated in a difficult environment. Oregon has consistently had a higher unem- 
ployment rate than the national average. During the time that VISION operated, Oregon’s econo- 
my was often named the “worst” in the country. Its economic environment impacted not only the 
type of job opportunities available to VISION’s clients but also the staffing capacity and cohe- 
siveness of the program itself. The program had hoped to place many participants in jobs with the 
State of Oregon, Salem’s largest employer, but, due to budget shortfalls and a statewide hiring 
freeze, this goal never materialized. On the staffing side, VISION experienced a high rate of turn- 
over and was constantly trying to integrate new staff and acquire their buy-in. As a result of the 
statewide hiring freeze, the program was unable to fill these vacancies in a timely manner. 



The ERA Evaluation 

As in the other ERA sites, MDRC is using a random assignment research design to as- 
sess the effectiveness of the VISION program. Starting in May 2002 and ending in May 2004, 
TANF applicants entering the two participating Salem DHS welfare offices who met the criteria 
for Oregon’s welfare-to-work services were assigned, at random, to either the VISION group or 
the JOBS group, with 50 percent being assigned to each group. Sample members were notified 
of their research status by the random assignment clerk, who explained the ERA study and gave 
clients written material describing the project. 

MDRC is tracking both groups using data provided by the State of Oregon that show 
each individual’s monthly welfare and food stamp benefits and quarterly earnings in jobs cov- 
ered by the state’s unemployment insurance (UI) program. One year of UI follow-up data is 



'The Workforce Investment Act (WIA) of 1998 authorized funding for employment and training services 
and programs through a system of One-Stop Centers. 
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available for each person in the report’s analysis. One year of administrative records covering 
welfare and food stamp benefits is available for sample members who were randomly assigned 
through September 2003 (roughly 54 percent of the total sample). In addition, the ERA 12- 
Month Survey was administered to a subset of VISION and JOBS group members about one 
year after they entered the study. 

Because individuals were assigned to the VISION and JOBS groups through a random 
process, the two groups were comparable at the start of the study. Thus, any differences that 
emerged between the groups during the study’s follow-up period can be attributed to the 
VISION program; such differences are known as the “impacts” of the program. A total of 1 ,504 
single parents in the VISION and JOBS groups are included in this report’s analysis. 



The ERA Target Population 

The VISION program targeted low-income families with children who were TANF ap- 
plicants and who were potentially eligible for TANF. People became eligible for the ERA pro- 
gram when they first applied for aid. Once randomly assigned, unless it was determined that 
they were exempt from participating in work-related activities, TANF applicants entered into a 
job search period (called an “assessment period” in Oregon), lasting up to 45 days. Approx- 
imately 83 percent of the TANF applicants in the research sample for this study were single- 
parent families at the time of random assignment, and the analysis in this report focuses on the 
single parents in this group. As is typical of TANF applicants, the sample members seemed fair- 
ly “job-ready”; nearly 50 percent of them had been employed for more than two of the prior 
three years. Most had received TANF assistance for less than two years, and 41 percent of the 
sample had never received it. Nearly 70 percent had a General Educational Development 
(GED) certificate or a higher degree of education. Most sample members are white and English- 
speaking. Not surprising for a sample of TANF applicants, most had young children when they 
entered the study. 



Key Findings on Program Implementation 

• During the preemployment period, VISION was successful in engaging 
the large majority of program-eligible clients. VISION’s additional 
preemployment workshops, its location at the One-Stop Career Center, 
and its ability to extend job search were the primary differences be- 
tween it and JOBS. 

VISION was successful in engaging the large majority of program-eligible clients during 
the preemployment period. However, since participants in both VISION and JOBS were held to 
the same job search participation requirements, the two programs had similarly high levels of en- 
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gagement during this time. VISION created a set of preemployment workshops that were different 
from those in JOBS, inasmuch as they focused on career planning and job retention. Participation 
in the range of workshops was uneven, with a larger percentage of participants attending a few 
workshops but with few attending the full range of workshops available to them. 

While the services at the One-Stop Career Center were also available to individuals in 
JOBS, the VISION participants had a stronger and more immediate connection to the center. 
VISION was physically located there, and VISION staff provided participants with direct assis- 
tance in using its resources, such as the computer room, the Oregon Labor Marketing Informa- 
tion System, resume writing, mock interviews, and employer presentations. VISION staff could 
also access vocational training dollars by becoming co-enrolled in WIA, and VISION staff 
helped their customers through the enrollment process. 

If there were promising prospects for a client, VISION staff had the option of extending job 
search beyond the 45 -day period. In the end, VISION still operated wi t hin the parameters of wel- 
fare-to-work regulations, and since job opportunities were limited, clients often had to take “surviv- 
al” jobs rather than jobs that had advancement opportunities or were in their field of interest. 

• VISION staff struggled to develop and implement the postemployment 
retention and advancement component that made the program distinc- 
tive from JOBS. Even so, participants clearly appreciated staffs sup- 
port and their long-term message about advancement. 

Each VISION client worked with a case manager, who was employed by DHS, and a 
training and employment specialist, employed by Chemeketa Community College. The 
VISION case manager was primarily responsible for eligibility determination, and the training 
and employment specialist was in charge of the client’s job search, job retention, and career ad- 
vancement. VISION staff had a difficult time managing both employed and unemployed 
clients, and the bulk of their time was spent on preemployment responsibilities, particularly eli- 
gibility issues and individual crises. Staff often expressed frustrations about being crisis manag- 
ers and, thus, about being unable to focus on the larger advancement goals of VISION. Turno- 
ver also contributed to the staffs inability to move beyond preemployment concerns, because 
when there was a vacancy in the case manager positions, the training and employment special- 
ists were forced to take on some of the administrative duties. 

In addition, staff had a difficult time articulating what advancement should “look” like, 
and despite the various training that staff received on how to deliver retention and advancement 
services, staff reported that they did not have the skills or experience to develop and deliver ad- 
vancement services. Consequently, VISION had few services to offer their working clients, and 
the program stmggled to engage them. 
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Only when VISION was nearing its end and random assignment had stopped did staff 
have the time and resources to turn attention to working clients and the program’s postemploy- 
ment objectives. At that point — essentially, when random assignment had ended and caseloads 
had stopped growing — staff began dividing into specialized positions and focused more intent- 
ly on providing advancement services. As a result of the late focus on advancement, the services 
that were provided — such as individual meetings with the advancement training and employ- 
ment specialist and “Career Night” — suffered from low engagement in general. In hindsight, 
most of the staff felt that VISION would have operated more efficiently had roles been specia- 
lized earlier. 

Despite these challenges, participants repeatedly named VISION’s message about ad- 
vancement and the staffs customer service as the program’s greatest strengths. Participants 
stated that VISION staff recognized that getting a job was not an end in itself and encouraged 
them to pursue a desired career path, or a “field of fascination.” They clearly appreciated staffs 
support and guidance, and once advancement meetings began, the strong staff-client rapport 
enabled the advancement training and employment specialist to better address clients’ potential 
barriers and on-the-job issues. Less clear was how VISION staff helped clients achieve their 
long-term career objectives. 

In contrast, like most traditional welfare-to-work programs, JOBS conveyed a clear work- 
first message throughout its contacts with clients. Once clients were employed, the postemployment 
contacts — if there were any — dealt mainly with eligibility or supportive service issues. 

• Welfare and community college staff entered VISION with different 
philosophies about the program’s policies and goals, which affected the 
delivery of services. 

Delivering retention and advancement services within the parameters of the welfare-to- 
work system was a new and difficult pursuit. The two types of staff (which included five wel- 
fare case managers and four community college employment specialists) struggled to reconcile 
their different work cultures and philosophies, and welfare staff, in particular, had to make a 
large transition. They had to adjust to a customer-service, team environment, as opposed to one 
of process and regulations, and had to use “advancement” as the ultimate benchmark, rather 
than the work-first philosophy of the welfare system. These challenges affected team cohesive- 
ness and service delivery, and they contributed to, and were exacerbated by, the high turnover 
of VISION case managers. 

• The design of the VISION program helped link clients to public assis- 
tance. 
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While VISION operated under the same eligibility requirements for public assistance as 
JOBS did, VISION’s program design helped clients navigate the application processes and, 
therefore, provided better access to public assistance. Due to the program’s emphasis on cus- 
tomer service, a VISION case manager or training and employment specialist was readily avail- 
able to deal with eligibility issues and to help clients complete applications. Such aid was par- 
ticularly helpful in ensuring continued receipt of the Oregon Health Plan. 

Since VISION staff had more long-term and frequent contact with participants than 
JOBS staff did, they were able to ensure that clients were at all times accessing the supportive 
services for which they were eligible. Finally, since VISION continued after clients were em- 
ployed and served those who were no longer eligible for TANF, staff were able to connect 
clients to government benefits immediately, if at any point they became eligible (for example, 
due to a job loss). 



Key Findings on Participation Impacts 

• Both VISION and JOBS clients reported relatively high levels of contact 
with staff. However, those in VISION had more staff contacts, including 
a slightly greater number of in-person meetings. 

While both research groups had extensive contact with program staff in the year follow- 
ing random assignment, the VISION program still produced an increase in the average number 
of staff-client contacts during this period. According to survey data, an individual in VISION 
had 22 contacts with program staff during the year, compared with 16 contacts for a member of 
the JOBS group. VISION group members were also slightly more likely to have in-person con- 
tacts. These impacts provide further evidence that VISION staff worked hard to reach out and 
be available to their clients. 

• A higher proportion of individuals in VISION than in JOBS partici- 
pated in job search activities. 

VISION increased the proportion of clients who participated in group job search or job 
club during the year following random assignment: 64 percent of the VISION group did so, 
compared with 49 percent of the JOBS group. This difference is most likely attributed to the 
fact that VISION participants had access to the program’s preemployment workshops and had a 
stronger connection to the Career Center’s job search services. The difference might also reflect 
VISION’s focus on client engagement. The program’s additional workshops focused on job 
retention and career paths and were unique to VISION; the workshops were not available to 
JOBS participants. 
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In addition, VISION group members were engaged in job search for an average of nine 
weeks — three weeks longer than JOBS participants. This could be a result of VISION’s ability 
to extend the job search period if clients had promising job prospects. 

• Individuals in VISION were more likely than those in JOBS to receive 
help with retention and advancement — particularly retention. 

The VISION program increased the proportion of clients who received some kind of 
help with job retention or advancement: 34 percent of the VISION group reported receiving 
help in this area, compared with 21 percent of the JOBS group. This nearly 14 percentage point 
increase appears to be driven by retention-related assistance — assistance in dealing with on- 
the-job and personal problems that could affect job retention. 

There was a small increase in the proportion of clients who received help with finding a 
better job while working: 9 percent of the VISION group reported this, compared with 4 percent 
of the JOBS group. Although this is encouraging, the difference is small. 



Key Findings on Economic Impacts 

• VISION did not generate statistically significant impacts on employment 
or earnings during Year 1. 

The VISION program in Salem, compared with JOBS, did not generate any statistically 
significant impacts on employment or earnings outcomes during the first year after clients en- 
tered the program (Table ES.l). In a typical quarter, about 40 percent of VISION group mem- 
bers were employed, compared with 42 percent of JOBS group members. Year 1 earnings for 
VISION group members are estimated to be about $270 below the JOBS group average of 
$4,100, but this difference is not statistically significant. By the last quarter of the follow-up 
period, the program was still not generating increases in earnings or employment. VISION, 
compared with JOBS, had no effects on employment and earnings across a variety of subgroups 
and cohorts. The program also had no effect on various measures of overall employment, as 
reported by respondents to the ERA 12-Month Survey. 

• VISION increased public assistance receipt but had no statistically sig- 
nificant effect on total income. 

Table ES.2 shows the impacts of VISION on public assistance receipt and income. The 
ERA program in Salem increased the percentage of clients receiving public assistance. The im- 
plementation research found that VISION increased the likelihood that TANF applications would 
be accepted, because staff maintained contact with clients longer and actively helped clients navi- 
gate the application requirements. Year 1 TANF payments were $365 (or 19 percent) higher 
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The Employment Retention and Advancement Project 
Table ES.l 



Year 1, Impacts on Ul-Covered Employment and Earnings 
Salem, Oregon 



Outcome 


VISION 

Group 


JOBS 

Group 


Difference 

(Impact) 


P- Value 


Year 1 










Ever employed (%) 


62.6 


62.8 


-0.3 


0.903 


Average quarterly employment (%) 


39.8 


42.3 


-2.5 


0.188 


Number of quarters employed 


1.6 


1.7 


-0.1 


0.188 


Employed 4 consecutive quarters (%) 


19.2 


21.9 


-2.8 


0.176 


Total earnings ($) 


3,831 


4,101 


-271 


0.346 


Earned over $10,000 (%) 


15.0 


16.4 


-1.4 


0.451 


Last quarter of Year 1 










Ever employed (%) 


39.8 


42.1 


-2.4 


0.331 


Total earnings ($) 


1,136 


1,193 


-58 


0.550 


Sample size (total = 1,504) 


742 


762 







SOURCE: MDRC calculations from UI administrative records from the State of Oregon. 



NOTES: Estimates are regression-adjusted using ordinary least squares, controlling for sample member 
characteristics. 

Statistical significance levels are indicated as follows: *** = 1 percent; ** = 5 percent; * = 10 percent. 

Rounding may cause slight discrepancies in calculating sums and differences. 

This table includes only employment and earnings in jobs covered by the Oregon unemployment 
insurance (UI) program. It does not include employment outside Oregon or in jobs not covered by UI (for 
example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). 

A two-tailed t-test was applied to differences between outcomes for the program and control groups. 

"Year 1 " refers to Quarters 2 to 5. Quarter 1 is the quarter in which random assignment took place. 

Dollar averages include zero values for sample members who were not employed or were not receiving 
TANF or food stamps. 

The p-value indicates the degree of likelihood that the difference between the program and control 
group arose by chance. 

The average quarterly employment measure was computed by adding up the number of quarters 
employed and dividing by the total number of quarters potentially employed. 

Random assignment extended from May 2002 through May 2004. The full research sample includes all 
single parents who were randomly assigned in Salem. Employment and earnings outcomes are available for the 
full research sample. One year of follow-up on outcomes of public assistance are available only for those 
randomly assigned from May 2002 through September 2003. 
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The Employment Retention and Advancement Project 
Table ES.2 



Year 1, Impacts on Public Assistance and Measured Income 

Salem, Oregon 



Outcome 


VISION 

Group 


JOBS 

Group 


Difference 

(Impact) 


P- Value 


Ever received TANF (%) 


64.1 


58.5 


5.6 * 


0.074 


Amount of TANF received ($) 


2,319 


1,954 


365 ** 


0.014 


Ever received food stamps (%) 


94.1 


93.6 


0.5 


0.720 


Amount of food stamps received ($) 


2,739 


2,579 


160 ** 


0.044 


Number of months receiving TANF 


4.9 


4.1 


Q g *** 


0.008 


Number of months receiving food stamps 


9.6 


9.2 


0.4 * 


0.077 


Total measured income 3 


8,546 


8,138 


409 


0.243 


Last quarter of Year 1 










Ever received TANF (%) 


39.5 


32.3 


7 2** 


0.017 


Amount of TANF received ($) 


495 


400 


96 ** 


0.022 


Ever received food stamps (%) 


77.9 


74.0 


3.9 


0.142 


Amount of food stamps received ($) 


626 


566 


60 ** 


0.025 


Combinations of work and welfare receipt (%) 










Employed, not receiving TANF 


27.2 


32.1 


-4.9 * 


0.093 


Employed, receiving TANF 


10.5 


8.6 


1.9 


0.321 


Not employed, receiving TANF 


29.0 


23.7 


5.4 * 


0.053 


Not employed, not receiving TANF 


33.3 


35.7 


-2.4 


0.435 


Received no measured income 3 (%) 


13.8 


17.6 


-3.8 


0.102 


Sample size (total = 977) 


478 


499 







(continued) 
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Table ES.2 (continued) 

SOURCES: MDRC calculations from UI, TANF, and food stamp administrative records from the State of 
Oregon. 

NOTES: This table includes only employment and earnings in jobs covered by the Oregon unemployment 
insurance (UI) program. It does not include employment outside Oregon or in jobs not covered by UI (for 
example, "off-the -books" jobs, some agricultural jobs, and federal government jobs). 

a Total measured income represents the sum of unemployment insurance (UI) earnings, TANF, and food 
stamps for the ERA group. 

Estimates were regression-adjusted using ordinary least squares, controlling for pre-random assignment 
characteristics of sample members. 

Statistical significance levels are indicated as: *** = 1 percent; ** = 5 percent; * = 10 percent. 
Rounding may cause slight discrepancies in calculating sums and differences. 

"Year 1” refers to Quarters 2 to 5. Quarter 1 is the quarter in which random assignment took place. 
Dollar averages include zero values for sample members who were not employed or were not receiving 
TANF or food stamps. 

The p- value indicates the degree of likelihood that the difference between the program and control 
groups arose by chance. 

Random assignment extended from May 2002 through May 2004. The full research sample includes all 
single parents who were randomly assigned in Salem. Employment and earnings outcomes are available for 
the full research sample. One year of follow-up on outcomes of public assistance are available only for those 
randomly assigned from May 2002 through September 2003. 



among VISION group members, compared with the JOBS group average of $1,954. VISION 
group members were almost 6 percentage points more likely to have ever received TANF than 
JOBS group members. VISION group members also received $160 more in food stamp pay- 
ments than the JOBS group average of $2,579 in Year 1. The increase in food stamp receipt is a 
positive impact — particularly in Oregon, which was considered one of the “hungriest” states in 
the nation when VISION started. VISION also increased public (and overall) health insurance 
coverage, which could be a byproduct of increasing TANF receipt and overall efforts to help 
clients with eligibility issues. 



Conclusions and Policy Implications 

Though a one-year follow-up period is far from definitive, so far the employment, re- 
tention, and advancement impacts of the VISION program are not encouraging. Overall, it 
seems that a combination of factors made it difficult for VISION to achieve its goals. 

• Program operators indicated that a pre- to postemployment model of re- 
tention and advancement was difficult to implement. Furthermore, staff 
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had a difficult time understanding how to operationalize advancement 
in the context of everyday services. 

The program model appears to require a great deal of specialization and staff. Making 
the same staff responsible for both pre- and postemployment issues may have been possible on- 
ly with very small caseloads. With large caseloads, job placement and reemployment naturally 
take priority over job retention and career advancement. 

VISION’s program design would likely have been more successful had staff been 
equally comfortable and skilled in providing both the retention and the advancement service 
components. The postemployment component was most fully implemented late in the evalua- 
tion period, and there were some increases in participation in retention and advancement servic- 
es. Thus, VISION may have benefited if staff had first had a chance to understand and gain ex- 
perience in the less familiar advancement component. This might have encouraged VISION 
case managers to buy into the concept of advancement in general and might have allowed the 
training and employment specialists to build confidence in their career-coaching abilities. 

• A challenging external environment can prevent a program model from 
being implemented as intended. 

A weak economy, state staffing cutbacks, staff turnover, a hiring freeze, and manage- 
ment staff whose time was divided among a number of competing duties impacted the VISION 
program throughout the evaluation. The hiring freeze affected both clients and caseworkers. 
Clients were unable to find jobs in the public sector — a major employer of former welfare re- 
cipients in Salem — and staff became overextended and bumed-out as program positions went 
unfilled. In addition, VISION was evaluated against a competing program, JOBS, that had a 
strong work-first focus. While it may be that, in difficult external circumstances, a program like 
VISION is unlikely to generate impacts, other ERA sites that have attempted to work with 
clients both before and after employment have also had serious operational difficulties, even 
under better circumstances. 

• It is important to account for institutional differences when merging line 
staff of partner organizations. 

Conflicting work cultures and philosophies came into play when merging community 
college and welfare staff in the Salem ERA program. VISION managers not only had to align 
partner organizations but also had to account for the different environments and operating cul- 
tures to which staff were accustomed. Facilitating communication and establishing clearer pro- 
gram boundaries up-front may have helped. 

* * * 
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It is likely that some combination of the factors discussed above contributed to the weak 
impacts of the VISION program, compared with the JOBS program, to date. However, these 
results are not the final word on the ERA program in Salem. MDRC will continue to track the 
impacts of VISION using unemployment insurance records. 
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Introduction 



This report presents interim results for the Salem site in the national Employment Re- 
tention and Advancement (ERA) project. Conceived and funded by the Administration for 
Children and Families (ACF) in the U.S. Department of Health and Human Services, and also 
supported by the U.S. Department of Labor (DOL), the ERA project is testing innovative pro- 
gram models across the county that aim to promote steady work and career advancement for 
current and former welfare recipients and other low-wage workers. MDRC, a nonprofit, nonpar- 
tisan research organization, is conducting the ERA project under contract to ACF, and is pro- 
ducing a similar interim report for each site in the project. 

The Salem ERA program, which operated from May 2002 through May 2004, targeted 
individuals applying for Temporary Assistance for Needy Families (TANF) cash assistance 
benefits who were unemployed. 1 The ERA program was designed to help participants — most- 
ly single mothers — secure more and better-than-usual initial job placements and then advance 
in the labor market. 

The program was jointly administered by staff from the Oregon Department of Human 
Services (DHS) — specifically, the Children and Adult Family Services Division — and Che- 
meketa Community College. While it did receive some additional funds for its specialized ERA 
services, the program was primarily funded within DHS’s larger contract for regular welfare-to- 
work services. 

This section provides background information on the national ERA project, the Salem 
site, and the research design for the project. 



Overview of the National ERA Project 

For over a decade, policymakers and program operators have struggled to learn what 
kinds of services, supports, and incentives are best able to help low-income working parents 
retain steady employment and move up to better jobs. This issue has assumed even greater ur- 
gency in the wake of the 1 990s welfare reforms, which made long-term welfare receipt much 
less feasible for families. Despite many efforts, scant evidence exists about effective strategies 
to promote employment retention and advancement. Previously evaluated programs that were 
aimed at improving retention or advancement — notably, the Post-Employment Services Dem- 
onstration (PESD), a four-site project that tested programs, including one in Oregon, that pro- 



1 Prior to the full demonstration, Salem operated a pilot ERA program from February through April 2002. 
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vided follow-up case management to welfare recipients who found jobs — generally failed to 
improve employment outcomes. 

The Employment Retention and Advancement project was designed to improve on past 
efforts in this area by identifying and testing innovative models designed to promote employment 
stability and wage progression among welfare recipients and other low-income groups. The 
project began in 1998, when ACF of the U.S. Department of Health and Human Services (HHS) 
issued planning grants to 13 states to develop new programs. The following year, HHS selected 
MDRC to conduct an evaluation of the ERA programs. 2 From 2000 to 2003, MDRC and its sub- 
contractor, The Lewin Group, worked closely with the states that had received planning grants, 
and with several other states, to mount tests of ERA programs. MDRC, Lewin, and Cygnet Asso- 
ciates also provided extensive technical assistance to some of the states and program operators, 
since most were starting the project from scratch, with no proven models on which to build. 

Ultimately, a total of 16 ERA models were implemented in eight states. Almost all the 
programs targeted current or former recipients of Temporary Assistance for Needy Families 
(TANF) — the cash welfare program that mainly serves single mothers and their children — but 
the program models are very diverse. One group of programs targets low-wage workers and fo- 
cuses on advancement. Another group targets individuals who are considered “hard to employ” 
and primarily aims to place them in stable jobs. Finally, a third group of programs has mixed goals 
and targets a diverse set of populations, including former TANF recipients, TANF applicants, and 
low-wage workers in particular firms. Some of these programs initiate services before individuals 
go to work, while others begin services after employment. Each model is described in Appendix 
Table A. 1. 

The evaluation design is similar in most of the sites. Individuals who met ERA eligibili- 
ty criteria (which varied from site to site) were assigned, at random, to the program group — in 
Salem’s case, the VISION group — or to the control group, which in Salem was the regular 
welfare-to-work program, the Jobs Opportunities and Basic Skills Training (JOBS) program. 
Members of the ERA group were recruited for the ERA program (and, in sites like Salem, were 
required to participate in it), whereas members of the control group were not eligible for ERA 
services. The extent and nature of the services and supports available to the control group varied 
across the ERA sites. The random assignment process ensured that any differences in outcomes 
that emerged between the two research groups during the follow-up period can be confidently 
attributed to the ERA program, rather than to differences in the characteristics of the people in 
the groups. 



2 The U.S. Department of Labor has also provided funding to support the ERA project. 
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The Salem ERA Program 



Origins and Goals of the Salem ERA Program 

In recent decades, Oregon has strived for a higher level of service integration among its 
state and local agencies, and, throughout the 1990s, the state had led efforts to improve its work- 
force development services. With the onset of the Workforce Investment Act (WIA) and the con- 
sequent establishment of a network of One-Stop Career Centers, Oregon recognized the impor- 
tance of integrating its state social service and workforce programs. 3 In 1999, Oregon chose to 
include its TANF (Temporary Assistance for Needy Families) and food stamp programs as man- 
datory WIA partners. In addition, Oregon’s Department of Human Services (DHS) reorganized its 
service delivery areas to correspond with the WIA workforce regions. The idea was that such re- 
organization would facilitate local collaboration and improve service coordination and referrals 
(that is, to TANF, food stamps, child care, child welfare programs, and the Oregon Health Plan). 

In Salem, specifically, the welfare, workforce, and community college systems had 
worked closely together — literally — to deliver employment-related services through WIA and 
through JOBS, the state’s welfare-to-work program. 4 Chemeketa Community College, Salem’s 
local community college, had been a significant partner and key player in the city’s workforce- 
welfare relationship. Winema Career Center, one of Salem’s One-Stop Centers and home to WIA 
services and partners, was operated under the college’s auspices. 5 In addition to delivering WIA 
services, Chemeketa staff were also contracted to provide the employment services in JOBS. 
While there were later frustrations that resulted from conflicting institutional philosophies and 
benchmarks, DHS and Chemeketa were a part of a one-stop regional network “considered to be 
among the most integrated and mature. . . . [T]he major partners have agreed to a level of coordi- 
nation in the centers that is not seen elsewhere in the state.” 6 (The frustrations and conflicts are 
described in the next major section, entitled “Implementation of the ERA Program in Salem.”) 

As mandated by the state, all welfare applicants, unless exempt, could be required to 
participate in a 45-day job search period, called the “assessment period,” before the opening of 
their TANF grants. The JOBS program provided applicants with job search services during that 
time, and participants worked with a case manager and an employment consultant. Case man- 

3 The Workforce Investment Act (WIA) of 1998 authorized funding for employment and training services 
and programs through a system of One-Stop Career centers. 

4 Winema Career Center was located on the Chemeketa Community College campus and down the street 
from the main branch of Salem DHS, which was home to the regular welfare-to-work program, JOBS. 

5 Chemeketa Community College is the Mid-Willamette Network’s WIA administrator and receives WIA 
funding to operate the Winema Career Center. In addition to Chemeketa Community College, DHS, the Office 
of Vocational Rehabilitation, and the Oregon Employment Department partner with the community college in 
providing services at the career center. 

6 Leete and Bania (2004). 
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agers, employed by DHS, were in charge of tracking participation and conducting intake and 
assessments and were responsible for authorizing supportive services. Employment consultants 
were Chemeketa staff, contracted by JOBS to deliver the employment-related services. These 
services included a group of workshops entitled “Employment Express,” which consisted of 
basic group job search, interview preparation, and resume development activities. 7 Services and 
staff were located at the local DHS branch office. 

Once clients secured a job, JOBS case managers provided information on them and de- 
termined their eligibility for work and transitional supports and TANF. The role of the JOBS 
employment consultant essentially ended once clients were employed. If clients initiated re- 
quests for additional help with job search (such as for a better job) or training, JOBS employ- 
ment consultants usually referred them to Winema Career Center. 

Oregon and Salem DHS had shown an active commitment to workforce retention and 
advancement, participating in state and federal initiatives and studies. In 2002, the time of ERA’s 
conception in Salem, Oregon’s DHS offices were required by the state to develop postemploy- 
ment strategies and activities (and to spend 25 percent of their budgets on such). In Salem, DHS 
and Chemeketa Community College had been in the midst of a retention initiative that took place 
at the site of an employer, and they provided participants with supportive services and skills train- 
ing assistance. The two organizations had also been involved in implementing an advancement 
program for entry-level state employees, many of whom were former welfare clients. 8 

These various experiences and the existing JOBS program all contributed to the ulti- 
mate design of the Salem ERA program, which is described below. Salem had identified the 
importance of engaging employers for the purposes of retention and advancement, and, conse- 
quently, a key goal of Salem’s ERA program was to develop strategies for employer involve- 
ment. Salem had also concluded that a strong client-staff relationship was integral to clients’ 
participation and the success of the program — hence, the idea that ERA services, if begun prior 
to employment, would positively impact initial job placement, retention, and advancement. The 
test would be whether such a model would help participants fare better in the labor market than 
those who went through JOBS. 

The Salem ERA Model 

Of the four ERA sites located in Oregon, the Salem ERA program was the only one de- 
signed to begin serving clients prior to their employment. 9 Called “VISION” (Valuing Individu- 
al Success and Increasing Opportunities Now), the program provided TANF applicants with job 

7 The title of the workshop was later changed to “POWER.” 

8 Clymer, Roberts, and Strawn (2001). 

9 Eugene, Medford, and Portland are the other three ERA sites in Oregon. 
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search and placement services, including workshops that focused on future job retention and 
career paths. Then, once clients secured employment, VISION continued with postemployment 
services that promoted retention and advancement. 

In creating the VISION program, it was natural to build on the established relationships 
among the local DHS office, Winema Career Center, and Chemeketa Community College. The 
program was jointly managed by Oregon DHS and Chemeketa. Services were offered at the 
Winema Career Center by a number of partner agencies, including the Office of Vocational Re- 
habilitation, DHS, the Employment Department, and Chemeketa Community College. 

Staff worked with both employed and unemployed clients, and each VISION client 
worked with a case manager employed by DHS and with a training and employment specialist 
employed by Chemeketa Community College. In addition to job search and placement services, 
VISION training and employment specialists were also in charge of retention and career ad- 
vancement. VISION case managers were responsible for all eligibility issues — TANF, food 
stamps, child care, transportation, and the Oregon Health Plan. They were also the ones who could 
authorize emergency payments if necessary. Winema Career Center was designated the physical 
home for VISION services and for both types of staff. Although the two types of staff had some 
distinctive responsibilities, VISION emphasized a customer-oriented model; thus, VISION staff 
were presented to clients as a team, any one of whom they could approach for help. 

VISION was designed to provide TANF applicants with more than the basic preem- 
ployment services provided in JOBS. VISION intended to help clients identify and work toward 
a job of interest and to continue to do so once they became employed, regardless of their eligi- 
bility for TANF. VISION infused its preemployment job search services with messages and 
activities related to advancement, including creating workshops that focused on keys to job re- 
tention and career goals. Once clients secured a job, postemployment services were scheduled 
to begin within a week of the new employment. Staff were to accommodate clients’ schedules 
and locations, meeting clients at sites other than their offices at the Career Center. The goal for 
the postemployment phase was to ensure that clients retained their jobs and began progressing 
toward the career and advancement goals that they had identified prior to their employment. 

Thus, retention and advancement were emphasized from the onset of the program, and 
the same staff worked with clients both before and after their employment. The reasons behind 
this design were threefold: (1) to introduce the idea of job retention to clients prior to job place- 
ment, (2) to encourage clients to think about career goals and advancement early on, and (3) to 
establish a rapport that would ensure clients’ long-term engagement and, therefore, participation 
in VISION’s postemployment services. 

In contrast, the JOBS program focused on job placement and was not designed to serve 
people once they were employed. Although Oregon disregarded 50 percent of a TANF reci- 
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pient’s earned income in calculating benefits, most who found employment were ineligible for 
assistance because of the state’s high minimum wage; therefore, postemployment follow-up and 
contact were essentially nonexistent. 10 In addition, while JOBS participants had access to assis- 
tance at the Career Center, few of them reportedly took advantage of the its resources. Finally, 
in contrast to VISION’s staffing structure, which had the two types of staff sharing responsibili- 
ties, JOBS staff had a clear division of responsibilities. Table 1 presents a comparison of the 
VISION and JOBS program models as they were designed. How the VISION model deviated 
from this original design and how the program was actually implemented are described in the 
next major section, “Implementation of the ERA Program in Salem.” 

Characteristics of the Salem ERA Site and Its External Environment 

The Salem ERA program operated from May 2002 through May 2004, and, during this 
time, Oregon’s economy was often named the “worst” in the country. 11 While Oregon has con- 
sistently had a higher unemployment rate than the national average, after the 2001 recession, the 
state suffered from particularly high unemployment rates. In 2003, the national unemployment 
rate hit a high of 6 percent; in comparison, Oregon’s unemployment rate in 2003 ranged from a 
low of 7.7 percent to a high of 8.5. 12 

Salem’s unemployment rates followed suit: When VISION was launched in 2002, Sa- 
lem’s annual unemployment rate was 8.6 percent — an increase from 6.3 percent the previous 
year. 13 In addition, Salem’s labor market had not been abundant in “better” jobs to begin with; it 
mainly comprised service sector and entry-level jobs with few promotional opportunities. 

From 2001 to 2003, Oregon’s TANF caseload increased almost 14 percent — from ap- 
proximately 16,000 cases to 18,000 cases in September 2003. 14 At the same time, funds for the 
TANF program were being reallocated to support other programs. 15 Consequently, emergency 
assistance and other ancillary support funds had to be eliminated, and, in June 2002, Oregon’s 
governor implemented a hiring freeze on state jobs that affected VISION’s clients and staff in 
several ways. First, the program was unable to fill its case manager vacancies, and, due to the 
high level of turnover, VISION was often left understaffed and overwhelmed. 



10 Oregon’s minimum wage ranged from $6.50 to $6.90 per hour through most of VISION’s operations. 
Beginning in 2004, the state’s minimum wage increased to $7.50 per hour, with annual adjustments for infla- 
tion that raised it to $7.80 per hour in 2007. 

1 'U.S. Department of Labor, Bureau of Labor Statistics (2006a). 

12 U.S. Department of Labor, Bureau of Labor Statistics (2006b). 

13 U.S. Department of Labor, Bureau of Labor Statistics (2006c). 

14 Center for Law and Social Policy (2004). In comparison, the national caseload decreased by almost 4 
percent. 

15 Funds for the TANF program had remained the same since 1996. 
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The Employment Retention and 
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Table 1 

Comparison of the VISION Model 



Feature VISION Model (ERA Group Program) 

Goals lob placement; job retention and career advancement 

Message “Dreamjob” 

Help clients identify and work toward a career of interest 
Primary location Winema Career Center 

Staff roles Overlapping responsibilities between DHS case managers and 

Chemeketa Community College training and employment 
specialists 

Same staff for both pre- and postemployment services 
Employer involvement Establish partnership with State of Oregon and private 

employers for purposes of job development and retention 
and advancement 

Preemplovment phase (includes a DHS assessment period that could last up to 45 days) 3 
Customer contact 2-3 times per week 

Job search and career- One-on-one meetings and VISION-specific workshops; focus 
planning services on skills, career interests and goals, and future job 

retention; direct link to and assistance with services at 
Winema Career Center 

Business Specialists and WIA-funded VISION staff together 
identify jobs with career tracks 



Postemplovment phase 



Client contact Meeting within 1 week of new job (preferably treat client to 

lunch); weekly contact for first 30 days; biweekly contact 
for 30 to 90 days 



Project 



the JOBS Model 

JOBS Model (Control Group Program) 

Job placement 
“Work first” 

No focus on “dreamjob” or on retention and advancement 
Oregon Department of Human Services (DHS) offices 
Clearly delineated roles for DHS case managers and Chemeketa 
Community College employment consultants 

Limited contact with employers for purposes of job development 
or retention and advancement 



Weekly contact monitored by DHS case managers 

“Employment Express/POWER” workshops; focus on basic job 
search, interview preparation, resume development; referrals 
to services at Winema Career Center 

Limited efforts to assist with job search or identify jobs with 
career tracks 

Little contact with clients; only at client’s request 



(continued) 




Table 1 (continued) 



Feature 


VISION Model (ERA Group Program) 


JOBS Model (Control Group Program) 


Postemulovment phase (continued) 




Job retention, education, 
and advancement 


Continued case management services, meetings with training 
and employment specialists and access to Career Center 


Not designed to provide postemployment services 


services 


resources; focus on job retention, job search for better jobs, 
on-the-job/educational advancement; ensure that clients 
receive all DHS-funded public benefits for which they are 
eligible 

Contact client’s employer within 30 days of new job to get 
employer’s support for client’s advancement goals 

Involve education and training providers in VISION; work with 
clients to explore options; offer any available incentives 
(such as day-planners, donated computers) 


Address public benefits at point of employment and 

recertification; referrals to Winema Career Center if employed 
clients request assistance with additional job search or 
educational or professional advancement 



NOTE: “Oregon’s welfare-to-work program, JOBS, included job search and was mandatory except for those who were exempt (for example, clients with medical 
conditions or late-term pregnancies). 




Second, VISION had hoped to work with the State of Oregon — Salem’s largest em- 
ployer and the one with the greatest number of entry-level jobs that had advancement oppor- 
tunities. However, because of the budget shortfall and hiring freeze, VISION’s goal of helping 
participants secure jobs and move up in the public sector was never realized. Even as the work- 
force in Oregon grew larger, the number of state jobs decreased. 

Third, Oregon was identified as one of the “hungriest” states in the nation from 2000 to 
2002. 16 As a result, the state implemented a very active and aggressive food stamp outreach 
program, with the goal of reaching every food stamp-eligible Oregonian, and it employed a new 
food stamp policy, which allowed an individual whose TANF grant was closed due to employ- 
ment to receive five additional months of food stamp benefits that did not take into account the 
new source of income. 

The Salem ERA Target Population 

The VISION program targeted low-income families who had children and who were 
potentially eligible for TANF — specifically, those served by the branch offices of DHS in 
North and South Salem. 17 People were assigned into the program when they first applied for aid 
and prior to the 45 -day job search period (assessment period), which was mandatory for all ex- 
cept those who were exempt from participating. 18 In JOBS, people who were determined to be 
exempt from job search were not required to participate in work-related activities; in VISION, 
however, those who were exempt remained as part of the staffs caseload and were included in 
the program’s outreach and service delivery efforts. 

Table 2 presents selected characteristics of the single parent sample members at base- 
line, or their time of random assignment. Approximately 83 percent were single-parent families 
(not shown). The sample members seem to have been fairly “job-ready”: 45 percent had been 
employed for more than two of the past three years. Most spoke English as their primary lan- 
guage, and the Salem sample is better educated than most other ERA research samples: Less 
than a third lacked some kind of education credential. Most had less than two years of prior 
TANF receipt, and 41 percent of the sample had never received TANF assistance. The typical 
sample member is female and white and was in her late twenties when she entered the study. 



16 Nord, Andrews, and Carlson (2003). 

l7 In Salem, random assignment was conducted after TANF applicants were screened and found to be po- 
tentially eligible for TANF. It was not uncommon for VISION staff to determine that clients were not eligible 
after random assignment had occurred, when sitting down with them during the first meeting to review their 
applications. Applicants could be determined as ineligible, for example, because they had failed to disclose 
child support payments that put them over the income ceiling. 

l8 While some people who did not find jobs at the end of the 45-day job search period ended up ineligible 
for TANF, staff reported that their number was not considerable. 
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The Employment Retention and Advancement Project 
Table 2 

Selected Characteristics of Sample Members at Baseline 



Salem, Oregon 



Characteristic 


Total 


Gender (%) 


Female 


89.6 


U.S. citizenship (%) 


98.3 


Primary language (%) 


English 


97.5 


Spanish 


1.6 


Other 


0.9 


Race/ethnicity (%) 


White, non-Hispanic 


70.3 


Black, non-Hispanic 


2.7 


American Indian, Alaska native, Asian/Pacific islander 


4.9 


Hispanic 


15.4 


Other 


6.7 


Age (%) 


Younger than 20 


9.4 


21-30 


51.8 


31-40 


27.7 


Older than 40 


11.0 


Average age (years) 


29.5 


Education (%) 


General Educational Development (GED) certificate 


27.7 


High school diploma 


31.1 


Technical certificate/associate's degree/2-year college program 


7.5 


4 years (or more) of college 


2.2 


None of the above 


31.5 


Housing status (%) 


Rent, public housing 


6.2 


Rent, subsidized housing 


11.6 


Rent, other (unsubsidized) 


42.3 


Own home or apartment 


2.9 


Emergency or temporary housing 


26.1 


Other, living with friends/relatives 


11.0 



(continued) 
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Table 2 (continued) 



Characteristic 


Total 


Current cash assistance status (%) 


Applicant 


99.9 


Recipient 


0.1 


Registration status (%) 


Mandatory 


89.8 


Exempt 2 


10.2 


Total prior AFDC/TANF receipt (%) 


None 


41.3 


Less than 3 months 


6.7 


3 months or more and less than 2 years 


31.8 


2 years or more and less than 5 years 


14.1 


5 years or more and less than 10 years 


5.9 


10 years or more 


0.1 


Months employed in past 3 years (%) 


0 (Did not work) 


10.6 


6 or less 


11.4 


7 to 12 


16.0 


13 to 24 


17.2 


More than 24 


44.8 


Currently employed (%) 


9.4 


Number of children (%) 


0 


4.3 


1 


45.7 


2 


31.3 


3 or more 


18.7 


Age of youngest child (%) 


2 or younger 


41.4 


3 to 5 


23.2 


6 or older 


35.4 


Sample size (total = 1,504) 





SOURCE: Baseline information form. 



NOTE: Tn contrast to JOBS, Oregon's regular welfare-to-work program, VISION actively engaged clients 
and provided services to those who were deemed to be medically exempt. 
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About the ERA Evaluation in Salem 



The Research Design 

Research Questions 

The ERA evaluation focuses on the implementation of the sites’ programs and their ef- 
fects, or “impacts.” Key questions addressed in this report are summarized below. 

• Implementation, How did DHS and Chemeketa Community College man- 
age and execute the ERA program? What services and messages did 
VISION provide and emphasize? How was this different from JOBS, the 
regular welfare-to-work program? How did VISION staff spend their time? 

• Participation, Did VISION succeed in engaging a substantial proportion of 
individuals in services? What types of services did people receive? What 
were possible reasons for nonparticipation? To what extent did the program 
increase service levels above the levels that would “normally” be received, as 
represented by the control group’s behavior? What were people’s expecta- 
tions about VISION’s services, and how did these expectations align with 
their actual experiences? 

• Impacts. Within the follow-up period, did VISION increase employment 
and earnings, lead to employment stability and wage growth, and improve 
job characteristics for the VISION group, relative to the control group? Did 
the program have any effects on participants’ use of public assistance or on 
their total income? 

The Random Assignment Process 

Starting in May 2002, potentially eligible TANF applicants entering the participating Sa- 
lem DHS welfare offices who met the criteria for normal welfare-to-work services were assigned, 
at random, to either the VISION group or the JOBS group, with 50 percent being assigned to each 
group. 19 Sample members were notified of their research status by the random assignment clerk, 
who explained the ERA study and gave clients written material describing the project. Figure 1 
presents an overview of the service flow and the random assignment process in Salem. 

19 The following categories of TANF applicants were excluded from the random assignment process: any- 
one receiving Supplemental Security Income (SSI); nonparent households (defined as someone applying for 
TANF for a dependent child related to them but not asking for TANF for themselves); teen parents (19 years 
old or younger); and ineligible citizens (defined as someone who is an adult and a noncitizen but who may be 
applying for TANF for their U.S.-born children). 
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The Employment Retention and Advancement Project 

Figure 1 

Overview of Service Flow in Salem 




NOTE: a All applicants, unless exempt, were required to participate in job search activities prior to the onset of 
TANF. This period of time was called the “assessment period,” and it could last up to 45 days. 
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Individuals who were assigned to the VISION group would meet with a VISION case 
manager and, usually, a VISION training and employment specialist as well. During this time, 
staff reiterated the benefits of the program to the client, focusing on the job placement services 
as well as VISION’s retention and advancement services once the client was employed. The 
VISION team would also begin completing a Personal Development Plan (PDP) for the client, 
which reflected the client’s short- and long-term career goals and the tasks needed to achieve 
those goals. The idea was that the PDP would be updated as often as needed. 

VISION group members were also referred to a VISION orientation, during which staff 
administered a short “needs assessment” and the Substance Abuse Subtle Screening Inventory 
(SASSI). The needs assessment was a DHS form that asked clients about special needs (medi- 
cal, mental health, domestic violence, or substance abuse issues) that had to be addressed or 
they would affect participation in services. SASSI is an industry-recognized assessment tool, a 
questionnaire that screens for possible substance abuse issues. Clients with a potential problem 
were referred to a counselor who conducted further assessment and referred them to substance 
abuse services if necessary. Usually, the PDP was written to reflect the client’s participation in 
these services. All other assessments were administered on an as-needed basis. 

The Counterfactual: What Is VISION Being Compared With? 

Individuals who were randomly assigned to the control group — who represent the 
counterfactual for the study — were told about the ERA study by DHS staff. Staff explained 
that, as part of the evaluation, these individuals were selected to be part of a group that would 
receive the current, standard employment services offered by DHS (in the JOBS program), 
while another group would receive services from the new ERA program, VISION. Control 
group members were informed that their TANF, food stamp, Medicaid, and unemployment in- 
surance (UI) records would be tracked and that they could be contacted to participate in surveys. 

Members who were assigned to the control group went through the regular welfare -to- 
work program, JOBS, which is described above. Like all welfare applicants, control group 
members — except those identified as exempt — were mandated to participate in the 45 -day 
job search period. During that time, JOBS participants worked with a case manager and an em- 
ployment consultant. 

The JOBS case manager conducted intake and completed the client’s Personal Devel- 
opment Plan (PDP). Unlike the VISION staff, the JOBS staff rarely revisited a client’s PDP to 
update and revise its goals prior to the opening of the client’s TANF grant. The JOBS client was 
then referred to a JOBS employment consultant and attended POWER — the orientation to the 
job search program — and began participating in JOBS employment services. 
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As described above, the JOBS program was housed at the welfare office, and there was 
minimal contact with clients after employment unless the clients initiated requests. While JOBS 
participants were free to access services at Winema Career Center, take-up of such services was 
reportedly low. Furthermore, the Career Center (outside of VISION) did not offer much in 
terms of retention services for participants who were not registered for Workforce Investment 
Act (WIA) services. While retention services were offered for those who enrolled in WIA, it 
was unlikely that JOBS participants would enroll. 

Data Sources 

The data sources for the analyses presented in the report are described below. 

Baseline Data 

Monthly, after each round of random assignment, MDRC collected data on sample 
members’ demographic characteristics from the MDRC random assignment module. This in- 
formation was used to describe the two main research groups in the study (see Appendix Table 
A.2) and to identify subgroups that are analyzed separately. 

Administrative Records 

Effects on employment and earnings were computed using automated unemployment 
insurance (UI) wage records data, and effects on public assistance were computed using auto- 
mated TANF and food stamp administrative records. One year of follow-up data was available 
for all sample members when the analyses for this report were conducted for the full research 
sample (in the case of UI data) and for those randomly assigned through September 2003 (in the 
case of public assistance data). All the analyses that were conducted using administrative 
records include single parents only. 20 

Program Participation and Implementation Data 

VISION provided MDRC with data on sample members’ participation in program ac- 
tivities. MDRC conducted a “time study” of ERA and JOBS staff, which tracked their activities. 
Information on program operations was obtained from interviews with VISION and JOBS staff 
and from reviews of participants’ case files. In addition, MDRC conducted focus groups with 
VISION participants selected by ERA staff: a group of eight who had participated in VISION, 
and a group of seven TANF recidivists who had participated in VISION and had previously 
gone through JOBS as well. 



20 There were too few sample members in two-parent families to permit a reliable analysis, but the general 
pattern of impacts is similar for both single- and two-parent families in the research sample. 
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The ERA 12-Month Survey 



Information about sample members’ participation in program services and about their 
employment, income, and other program outcomes was gathered by the ERA 12-Month Sur- 
vey, which was administered to a subset of ERA and control group members approximately 12 
months after random assignment. 

Sample Sizes 

A total of 1,820 people were randomly assigned in Salem between May 2002 and May 
2004. The fielded 12-month survey sample of 418 was selected from among those sample 
members who were randomly assigned from May to October 2003. A total of 300 people (72 
percent of the fielded sample) completed the survey and are called the “respondent sample.” 
The remaining 118 are called the “nonrespondent sample.” For more information about the 
samples used in this report, please see Appendix E. 



Roadmap of the Report 

This report focuses on the implementation and impacts of VISION, the ERA program 
in Salem, Oregon. The next section further describes the VISION program and its implementa- 
tion. Then the report provides information about the program’s impacts on participation and 
service receipt. The final section describes impacts on employment, earnings, job characteris- 
tics, and other outcomes. 
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Implementation of the ERA Program in Salem 



Summary 

VISION (Valuing Individual Success and Increasing Opportunities Now) — the Em- 
ployment Retention and Advancement (ERA) program in Salem, Oregon — provided job 
search services and workshops focused on job retention and advancement to welfare applicants 
prior to their employment, and, once participants became employed, it continued with individu- 
al retention and advancement services. VISION’s intention was to provide services to employed 
clients that would help them follow through on the goals they identified during their initial job 
search period, regardless of their eligibility for the Temporary Assistance for Needy Families 
(TANF) program. 

For reasons detailed in this section, VISION’s postemployment retention and advance- 
ment services were not implemented as intended. Postemployment advancement simply was not a 
focus of the program until after random assignment ended in 2004. In addition, turnover of Ore- 
gon Department of Human Services and Chemeketa Community College staff from the ERA 
program, and conflicting work philosophies between them, contributed to implementation chal- 
lenges. In the end, the program failed to markedly differentiate itself from the Job Opportunities 
and Basic Skills Training (JOBS) program, the state’s regular welfare-to-work program; as a re- 
sult, VISION struggled to engage its working clients in retention and advancement services. Table 
3 compares the VISION model as designed and the VISION program as implemented. 

Even with these limitations, participants seemed very positive about VISION. The pro- 
gram’s message about long-term goals and advancement and its enhanced customer service were 
repeatedly named by clients and staff as VISION’s strongest features. Participants agreed that the 
program was different because “across the street [at the welfare office], you are just a number.” 
Despite the challenges of the staffing design, for VISION’s participants, the staff support — the 
“one-on-one” — was what set the ERA program apart from regular welfare-to-work services. 



The Framework of the Salem ERA Program: Structure, Staffing, 
and Management 

• Colocation of staff and the lack of specialization along pre- and postem- 
ployment lines were intended to make services seamless and VISION more 
customer-friendly. However, these aspects of the program often prevented 
staff from focusing on their employed clients. 

• VISION experienced a high level of staff turnover and burnout, especially on 
the case manager side. Staff turnover resulted in heavy workloads, as vacant 
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positions were not filled quickly and VISION staff stepped in to assist clients 
when vacancies occurred. 

• Welfare and community college staff entered VISION with different philos- 
ophies about program policies and goals, which affected the delivery of ser- 
vices. 

Organizational and Staffing Structure 

As described in the Introduction, the VISION program was conceived and managed by 
a partnership between the Children and Adult Family Services Division of the Oregon Depart- 
ment of Human Services (DHS) and Chemeketa Community College. Services were delivered 
at Winema Career Center, where participants worked with a VISION case manager employed 
by DHS and a training and employment specialist employed by Chemeketa. These same staff 
worked with clients both before and after employment. In total, there were nine such staff pro- 
viding VISION services. 

Initially, VISION staff were selected for the program through a competitive process; in- 
terested staff applied for the position and were interviewed by an interview panel. 1 After being 
selected, all the original staff went through a Career Development Facilitation training course at 
Chemeketa Community College that included 120 hours of instruction and covered career as- 
sessment, job search, labor market analysis, and workshop facilitation. Staff also received train- 
ing from a consultant retained by MDRC. This training focused on how to market VISION’s 
services to potential participants and how to develop advancement plans, engage clients in re- 
tention and advancement services, and work with employers. 

Program managers worked well together but were stretched across many commitments, 
including overseeing other projects and staff. One VISION program manager was located off- 
site at the DHS office, and so this person was less involved in the daily operations of VISION. 
Consequently, the program manager who was located on-site at Winema Career Center carried 
a larger share of the daily management duties, stepping in to assist clients at times when the 
VISION program was short staffed. During field visits, some staff, especially the DHS case 
managers, commented that they would have preferred far more on-site supervision. Most 
VISION staff felt that management could have facilitated a better working relationship between 
the welfare and community college staff (as discussed below). 



'The process for selecting DHS staff changed partway through program implementation. After experienc- 
ing turnover in staff, DHS abandoned the staff selection process in favor of identifying volunteers or asking 
specific staff whether they would be interested in working on VISION. The process for selecting training and 
employment specialists remained the same throughout the period of program operations. 
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Staff were designed to operate as a team (see the Introduction) and to work with both 
employed and unemployed clients. Colocation at Winema Career Center facilitated this team 
collaboration. Thus, while training and employment specialists and case managers did have 
somewhat distinct roles, both became responsible for responding to clients’ requests about their 
eligibility, administrative, and other individual needs. Staff worked together to develop a Per- 
sonal Development Plan (PDP) for each client, to narrate case notes, and to teach workshops. 
They also met regularly to discuss the clients who were currently on their caseload. 

Program managers and staff reported that this staffing structure worked well during the 
pilot demonstration that VISION operated from February through April 2002. However, once 
the full program began in May 2002, staff realized that the intensity of services that they had 
envisioned would not be possible as workloads increased; with the growing number of cases, 
both the VISION staff and the JOBS staff had an average caseload of 75 clients. The JOBS 
staff, however, were only responsible for providing preemployment job search services. 

Managers and staff had strongly believed that having staff share responsibilities and 
having them work with clients both before and after employment would provide clients with 
more customer-friendly, seamless services and would ensure long-term engagement, thus im- 
proving the likelihood that clients would retain their jobs and advance. In practice, this lack of 
specialization created overwhelming workloads for staff and made it difficult to move beyond 
eligibility issues, individual crises, and other preemployment responsibilities. It became clear 
that if staff were responsible for both working and nonworking clients, the latter naturally took 
priority: Nonworking clients needed to meet participation requirements for TANF and were 
simply more available for services. Demanding drop-in clients — those described by staff as 
“squeaky-wheel” clients — became a source of great frustration for staff because of the time 
they took up and the number of employment barriers that they needed to address and resolve. 
Over the course of the program, the front-desk Workforce Investment Act (WIA) staff at 
Winema Career Center did become more adept at screening drop-in clients and assisting them 
with some of their basic requests. 

Management responded to workload challenges by specializing some of the staff re- 
sponsibilities. A VISION case manager was assigned to conduct follow-up calls to employed 
clients for retention purposes, and a form called “Opportunity Knocks” was mailed to all clients 
when they found employment. The form was used by the training and employment specialists to 
start conversations with clients about their career goals. Later on, management created an ad- 
vancement team composed of a training and employment specialist dedicated to providing re- 
tention and advancement services and a case manager focused on working with employed 
clients. Finally, toward the end of VISION, staff stopped running preemployment workshops, 
and the program managers transferred unemployed clients who had received more than a year 
of VISION’s services but who were still unemployed to a regular JOBS case manager. 
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By the end of VISION’s operations, program managers and staff had come full circle in 
their view of the staffing design. Staff still acknowledged the importance of building rapport but 
stated that the costs of sharing responsibilities and being in charge of both employed and unem- 
ployed clients far outweighed the benefits. Staff suggested that an ideal caseload would have 
been about 50 to 60 cases. Even with smaller caseloads, staff — especially the training and em- 
ployment specialists — felt that eligibility and employment functions needed to be clearly sepa- 
rated, and some even suggested that case managers should have remained at the DHS branch 
office: “It’s too hard; the eligibility part gets in the way of retention and advancement.” 

Institutional Culture 

As described in the Introduction, DHS and Chemeketa Community College had pre- 
viously partnered in various capacities, although most of their collaboration centered on services 
provided through JOBS, 2 and there was a minimal history of collaboration on WIA services. 
Through their collaboration on JOBS, the DHS and Chemeketa staff (who delivered JOBS ser- 
vices) were accustomed to TANF benchmarks, which were based primarily on job placements, 
whereas Chemeketa WIA staff adhered to the benchmarks of the Workforce Investment Act, 
which were based on entered employment, retention, and wage progression. Program managers 
acknowledged that the target populations of the two programs rarely overlapped. WIA seldom 
served those clients in the JOBS program who were “hard to employ” or most in need, because 
to do so made it difficult to meet WIA’s retention and wage-progression goals. Another factor 
was that DHS staff rarely referred clients to WIA, because of the perception that WIA was a 
training program that put everyone into longer-term training. 

However, the scope of VISION was broader than that of both the WIA and the JOBS 
programs. VISION was designed to deliver retention and advancement services within the pa- 
rameters of the welfare system — a new and difficult pursuit. Unlike WIA, VISION included 
the “hard-to-employ” TANF population; unlike JOBS, it aimed to help people with more than 
their immediate job search needs. Thus, the two types of staff struggled to reconcile their differ- 
ent work cultures and philosophies. The DHS case managers had a more difficult time transi- 
tioning, as they came from a culture governed by clear processes and responsibilities and by 
measures of participation that could be quantified. They had to adjust to a customer-service en- 
vironment in which staff worked as a team and roles were not specialized, and they had to adopt 
a mission of career advancement in place of the traditional “work- first” philosophy. For exam- 
ple, the training and employment specialists stressed that seeing drop-in clients was a key com- 
ponent of enhanced customer service; case managers — who were not accustomed to seeing 
clients immediately and so often — disagreed and stated that drop-in clients were too disruptive. 



2 Chemeketa has a prime contract with DHS to deliver JOBS services. 
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Such institutional differences most often resulted in disagreements about the provision 
of supportive services or emergency funds. On the Chemeketa side, training and employment 
specialists often expressed that case managers were not responding to clients’ needs and could 
be more flexible and generous in providing assistance. On the DHS side, the case managers 
stated that their job was made more difficult because the training and employment specialists 
did not understand state eligibility rules and the program regulations by which they had to ab- 
ide. As one case manager stated, “The Chemeketa staff [training and employment specialists] 
had a hard time keeping the program straight.” 

The challenges of merging welfare and community college staff both contributed to and 
were exacerbated by the high level of staff turnover and burnout that VISION experienced, es- 
pecially on the case manager side. This was due to growing caseloads, staff promotions, and the 
restrictive budgetary environment that prevented the hiring of new staff to fill vacancies (dis- 
cussed in the Introduction). Every time MDRC visited the site, there was a new complement of 
staff. During the period when there were staff vacancies, clients were shuttled back-and-forth 
among the existing staff, and it appears that some may have slipped through the cracks. As an 
example, in one meeting that MDRC observed (which did not represent a widespread expe- 
rience), a client had been reassigned to a different case manager and, somewhere in the process, 
VISION had lost track of the individual. 3 Consequently, the client’s application had expired, 
and she was in danger of having to restart the 45 -day job search process. While this may not 
have been a common experience for most clients, staff turnover and the higher caseloads that 
resulted contributed to the stress and burnout that staff experienced, especially since there were 
times when Chemeketa staff tried to step in to assist a client with eligibility issues, which were 
less familiar to them. 

Staff turnover disrupted not only service delivery but also staffs overall commitment to 
VISION’s goals. The original staff had been committed to the idea of a retention and advance- 
ment program and had been trained accordingly, but this commitment and training were lost as 
staff entered and exited the program at various times. VISION was constantly trying to integrate 
new staff into the program and to acquire some level of commitment. Case managers already 
had a more difficult time “buying into” customer service and advancement, and, according to a 
training and employment specialist, case managers were unable “to get the training or time to 
adjust — or some just couldn’t adjust — to the mindset of the project.” 

Toward the end of the program, both DHS case managers and the Chemeketa training 
and employment specialists reported that they had gained a better understanding of each other’s 
work styles and cultures. Given that the VISION model was complex and difficult to imple- 



3 This was a meeting with a client who had previously gone through intake but had lost contact with 
VISION during the job search, assessment period. 
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ment, program managers may have become better able over time to prepare the two types of 
staff to work with each other. Most staff stated that management could have facilitated commu- 
nication, and some suggested team-building and conflict-resolution workshops. All suggested 
ongoing training for both new h ir es and existing staff, in order to establish and reinforce the 
VISION model. 

This suggests that it is important for program managers to account for and resolve the 
different mindsets and work cultures that can exist among staff of partnering organizations. 
VISION had been designed to give staff the discretion and flexibility to help clients as they saw 
fit or as needs arose, but this also meant that staff had conflicting opinions about the type of ad- 
ditional help that was appropriate and when it was needed. Thus, program managers may have 
helped staff better communicate and negotiate with each other about such gray areas, particular- 
ly the provision of supportive services or emergency funds. Case managers may have felt less 
misunderstood, and training and employment specialists may not have not felt that case manag- 
ers were preventing clients from moving forward. 

Funding 

As noted in the Introduction to this report, Oregon’s economic environment and the 
consequent statewide hiring freeze affected the type of job opportunities available to VISION’s 
clients as well as the program’s staffing capacity. 

The services and supports that VISION provided to clients were adequately funded over 
the duration of the program. Child care was available as long as a client had a current Personal 
Development Plan (PDP). Once the plan expired, the child care funding did as well, although it 
was staffs responsibility to make sure that VISION clients had current PDPs for a period of one 
year following random assignment so that they could continue to receive child care. When a 
client found a job, child care was available, but the client was required to contribute to its cost 
through a copayment based on income. According to case managers, the supply of child care in 
Salem was sufficient, with the exception of child care for children who were ill. 

As for transportation, clients who were in the initial job search phase received money 
for either gasoline or their bus fare, as long as they were actively participating in VISION ser- 
vices. Once a client began work, transportation funding was available as needed (usually until 
the first or second paycheck), providing the client participated in the program’s postemploy- 
ment services. 
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The Services and Messages of the Salem ERA Program 

• For participants, the staff support and VISION’s message about advancement 
were the key components of the program. The location of VISION also contri- 
buted to participants’ more positive view of its services, compared with JOBS. 

• VISION was successful in engaging clients during the preemployment pe- 
riod, but once clients found employment, there was considerable drop-off in 
their participation. 

• Staff were comfortable addressing individual concerns and issues related to 
job retention, but staff on a whole never reached a level of comfort in provid- 
ing advancement services, especially given the late development of these 
services in Salem. As a result, VISION did not fully implement the retention 
and advancement components as outlined in the original program design. 

(Table 3 compares the proposed VISION model as it was designed and the 
VISION program as it was implemented.) 

Preemployment Engagement and Services 

Unemployed TANF applicants in Salem who were assigned to VISION were referred 
to an intake meeting and orientation at Winema Career Center. During these intake sessions, 
VISION staff invested much time and energy in marketing the program’s differences from 
regular welfare-to-work services, stressing the team approach, enhanced customer service, and 
ongoing services after job placement. Also during intake, the VISION case managers worked 
with each client to develop an individual Personal Development Plan (PDP), which outlined the 
client’s short- and long-term career goals. These goals were revisited and updated over the 
course of the program and after the client became employed. 

VISION staff had high levels of contact with clients during the preemployment job 
search period, partly because most participants were required to meet with staff once a week. 
Moreover, because VISION offered workshops four days per week, participants often dropped 
in informally after attending a workshop, and they accessed job search services at the Career 
Center. Despite the high rate of contact during the preemployment period, however, participants 
did not necessarily attend the full complement of workshops available. During an early assess- 
ment of program operations, MDRC staff found, through case file reviews, that only 54 percent 
of the participants had attended the introductory workshop and that less than half (48 percent) 
had attended the workshop entitled “Career Navigation” — and these are only two workshops 
out of approximately ten that were available. When clients did come in for a meeting with 
VISION staff, their case managers reviewed their participation and checked on their progress. 
The training and employment specialists conducted individual employability assessments and 
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The Employment Retention and Advancement Project 



Table 3 

Comparison of the Proposed VISION Model and the VISION Program as Implemented 






Feature 



VISION Model (as Designed) 



VISION Program (as Implemented) 



Goals 



Staff roles 



Employer involvement 



Education and training 
services 



Job placement; job retention and career advancement 



Overlapping responsibilities between DHS case managers and 
Chemeketa Community College training and employment 
specialists 

Same staff for both pre- and postemployment services 

Establish partnerships with State of Oregon and private 

employers for purposes of job development and retention 
and advancement 

Involve education and training providers in VISION; work with 
clients to explore options; offer any available incentives 
(such as day-planners, donated computers) 



More focus on retention-related issues than advancement; difficult 
for staff, particularly case managers, to adjust to the concept 
of advancement services 

Specialized staff roles as program evolved; by end of operations, a 
designated advancement team (one case manager and one 
training and employment specialist) 

Limited contact with employers in general; received job leads and 
employer information front Business Specialists at Winenta 
Career Center 

Little direct involvement of education and training providers; 
opportunities and payment/financial aid options explored by 
staff with clients; co-enrollment in WIA for training when 
appropriate 



Preemplovment phase (includes a DHS assessment period that could last up to 45 days) 2 

Customer contact 2-3 times per week 2-3 times per week plus informal drop-ins 



Job search and career- One-on-one meetings and VISION-specific workshops; focus 
planning services on skills, career interests and goals, and future job 

retention; direct link to and assistance with services at 
Winema Career Center 

Business Specialists and WIA-funded VISION staff together 
identify jobs with career tracks 



Strong rapport between staff and clients; most staff time spent on 
addressing employment barriers and eligibility issues relating 
to public benefits 

Emphasis on customer service to ensure that clients received the 
supportive services for which they were eligible 
Meetings and workshops successful in conveying VISION’s 
“dream job” message but less successful in helping clients 
achieve the related long-term goals 
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Table 3 (continued) 



Feature 



VISION Model (as Designed) 



VISION Program (as Implemented) 



Postemployment phase 



Client contact 



lob retention, education, 
and advancement 
services 



Meet with all clients within 1 week of a new job; weekly contact 
for first 30 days; biweekly contact for 30 to 90 days 

Continued case management services and access to resources at 
Winema Career Center to ensure that clients worked toward 
the advancement goals they established during the 
preemployment phase 



Irregular contact with clients; diligent but unsuccessful efforts to 
engage and maintain clients’ participation in the program after 
they became employed 

During most of VISION’s operations, struggles to follow up 
working clients for retention and advancement purposes; 
toward the end of the program, added “Career Night” and 
advancement meetings 



Contact client’s employer within 30 days of new job to get 
employer’s support for client’s advancement goals 



Minimal contact with clients’ employers 



to 

Lfl 



NOTE: “This was mandatory and included job search, except for those who were exempt (for example, clients with medical conditions or late-term pregnancies). 




provided job leads, strategies, and encouragement, speaking with clients about developments in 
their job search. 

During the initial job search phase, the main differences between the JOBS program 
and the VISION program were the workshops that VISION created, the location of VISION 
services, the frequency of interaction between VISION clients and staff, and — the most signif- 
icant difference for clients — the VISION staffs support and their message about career ad- 
vancement. 

First, in contrast to the job search workshops in the JOBS program, VISION created a 
series of workshops that focused on job retention and career paths. Workshop titles included 
“Take This Job and Love It,” “Personal Styles at Work,” “Job Retention Strategies,” “Decision- 
Making,” and “Career Navigation.” Yet, although VISION had a high level of preemployment 
contact with clients in general, staff reported that they had a difficult time motivating clients to 
attend all the workshops available. Furthermore, even though the workshops were fairly interac- 
tive, they served as isolated sessions rather than as reinforcing modules. Initially, staff did not 
follow up on the workshop discussions or offer specific guidance or strategies for achieving the 
goals that clients identified. To address this problem, staff added a follow-up item to the work- 
shop evaluations that participants prepared. The evaluation items — such as “List one thing 
from this workshop you will use in your family life” — were designed to encourage clients to 
think about how they would apply the workshops’ retention and advancement information to 
their daily life at work and at home. 

Second, VISION’s location at Winema Career Center provided a strong and direct link 
to the center’s services. Universal services were available to everyone and consisted of the use 
of the Winema resource room, where anyone could access technology and tools (for example, 
computers, labor market information, faxes, and phones) to conduct a self-directed job search. 
Individuals who needed more help and were eligible for WIA could receive more intensive case 
management assistance in conducting their job search. Intensive services included one-on-one 
assistance in preparing resumes, participating in mock interviews, and obtaining job leads. Dol- 
lars for vocational training, offered through either eligible training providers or the community 
college, were also available through WIA, including on-the-job training. The physical location 
of the VISION program, which was housed at the Career Center, and VISION staff’s familiarity 
with WIA resources and program eligibility rules, gave VISION participants greater access to 
WIA services than JOBS participants, who may not have known how to access these resources. 
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